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Abstract. - Fluctuations of the total entropy are experimentally investigated in two stochastic 
systems in a non-equilibrium steady state : an electric circuit with an imposed mean current and 
a harmonic oscillator driven out of equilibrium by a periodic torque. In these two linear systems, 
we study the total entropy production which is the entropy created to maintain the system in the 
non-equilibrium steady state. Fluctuation theorem holds for the total entropy production in the 
two experimental systems, both for all observation times and for all fluctuation magnitudes. 
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, Thermodynamics of systems at equilibrium has been de- 
A^eloped by defining the internal energy, the injected work, 
and the dissipated heat. The first law of Thermodynam- 
ics describes energy conservation and gives a relation be- 
tween those three energies. The second law of Thermo- 
dynamics imposes that the entropy variation is positive 
for a closed system. Statistical Physics further gives a 
liiicroscopic definition of entropy, which allows analytical 
results on entropy production. The extension of Thermo- 
dynamics to systems in non-equilibrium steady states is 
an active field of research. Within this context, the first 
l&,w has been extended for stochastic systems described 
by a Langevin equation [1-3]. It has been noted that the 
Second law is not verified at all times but only in aver- 
age, i.e. over macroscopic times : entropy production 
Can have instantaneously negative values. The probabil- 
ities of getting positive and negative entropy production 
arc quantitatively related in non-equilibrium systems by 
the Fluctuation Theorem (FT). This theorem has been 
first demonstrated in deterministic systems [4-6] and sec- 
ondly extended to stochastic dynamics [7-10]. FTs for 
work and heat fluctuations have been theoretically and 
experimentally studied in Brownian systems described by 
the Langevin equation [2,3, 11-18]. For these systems in 
non-equilibrium steady state. Fluctuation Theorems hold 
only in the limit of infinite time: 

fp{Xr = +c 



(f>(a) = In 



for r 



(1) 



\p{Xr^-a)J ksT 

where ks is the Boltzmann constant, T the temperature 
of the heat bath and p{Xr) is the probability density func- 
tion (PDF) of Xr. $ is called symmetry function and Xr 



stands for either injected work or dissipated heat, averaged 
over a time lag r. For the injected work, eq. 1 is valid for 
all fluctuation magnitudes a ; for the dissipated heat, eq. 1 
is satisfied for values lower than the mean value [13]. 

We are interested here in the total entropy production 
in a non-equilibrium steady state (NESS), introduced in 
ref. [19-21] and directly related to previous work on house- 
keeping heat [22,23]. Entropy production has been stud- 
ied both theoretically and experimentally in several sys- 
tems [24-30]. In [19], Seifert and Speck have shown that 
the total entropy production for a stochastic system de- 
scribed by a first order Langevin equation in a NESS sat- 
isfies a Detailed Fluctuation Theorem (DFT) : 



$(a) = In 



fp{Xr = 



\p{Xr 



knT 



Vt Va 



(2) 



The relation (2) is valid for all integration time r and 
all fiuctuation magnitudes of the total entropy produc- 
tion. This relation is closely related to the Jarzynski and 
Crooks non-equilibrium work relations [31,32] which can 
be exploited to measure equilibrium free energy in exper- 
iments [33-37] and it has been extended to Markov pro- 
cesses [38]. 

In this Letter, we measure the total entropy produc- 
tion in two out-of-equilibrium systems and show that this 
quantity verifies eq. (2). In the first part of the letter, we 
recall the general definition of dissipated heat, "trajectory- 
dependent" entropy and total entropy production. In the 
second part, we detail our two experimental systems. The 
first one is an electric circuit maintained in a NESS by 
an injected mean current. The second system is a torsion 
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pendulum driven in a NESS by forcing it with a periodic 
torque. 

The heat dissipated by the system is the heat given to 
the thermostat during a time r ; we note it Qr . It is related 
to the work WV, given to the system during the time r, 
and to the variation of internal energy At[/ during this 
period, thanks to the first law of Thermodynamics: 



]r^Wr-KU. 



(3) 



Expressions of Wr and At-[/ for our two experimental se- 
tups arc given below. Following notations of ref [19], we 
define the entropy variation in the system during a time r 
as : 

ASm.r = 7fQr (4) 

where T is the temperature of the heat bath. For ther- 
mostated systems, entropy change in medium behaves like 
the dissipated heat. The non-equilibrium Gibbs entropy 

is : 



S{t) 



dfp(x(t), f. At) \np{x{t), t. At) = {s{t)) 



(5) 

where At denotes the set of control parameters at time 
t and p(x(t),t, Xt) is the probability density function to 
find the particle at a position x(t) at time i, for the state 
corresponding to At. This expression allows the definition 
of a "trajectory-dependent" entropy : 



s{t) = -fcs lnp(x(<), t. At) 



(6) 



The variation Astot.r of the total entropy stot during a 
time T is the sum of the entropy change in the system 
during r and the variation of the "trajectory-dependent" 
entropy in a time r, As^ = s{t + t) — s{t) : 



As, 



t (t + t) - Stot (t) = As,„,^ + ASr (7) 



In this letter, we study fluctuations of Astot.r computed 
using (4) and (6). We will show that Astot.r satisfies a 
DFT (cq. (2)). In ref. [38], the relevance of boundary 
terms like As,- has already been pointed out. 

Our first experimental system is an electric circuit com- 
posed of a resistance R = 9.22 MO in parallel with a ca- 
pacitance C = 278 pF [15]. The time constant of the 
circuit is tq = RC = 2.56 ms. The voltage V across the 
dipole fluctuates due to Johnson-Nyquist thermal noise. 
We drive the system out of equilibrium by injecting a con- 
stant controlled current / = 1.06 • 10~^^ A. After some 
To, the system is in a NESS. Electric laws give in this 
setup [15] : 

dV 
ro^ + V = RI + ^, (8) 

where ^ is the Gaussian thermal noise, delta-correlated in 
time of variance 2kBTR. 

Multiplying (8) by V and integrating it between t and 
t + T, we define the work Wt, injected into the system, and 



the dissipated heat Qt, together with the internal energy 

U : 



Wr 



Qr = 



t+T 



V{t')Idt' 



t+T 



Vit')in{t')dt' 



(9) 
(10) 



ArU = -C{V{t + Tf -V{t)'')=Wr-QT {W) 

where i^, is the current flowing in the resistance : i^ = 
/ — C^. This system has only one degree of freedom, so 
the trajectory in phase space is defined by the voltage V(t) 
alone, and the only external parameter is the constant 
current /. So the variation of the "trajectory-dependent" 
entropy during a time r is : 



As,- — —kB In 



piV{t)) 



(12) 



Fluctuation relations for the injected work and the dis- 
sipated heat (or entropy change in medium) in this system 
have been reported in [15]. Let us recall the experimental 
results for the dissipated heat T.Asm.r, for several val- 
ues of the integration time. Its average value (T.Asm ,-) 
is equal to the average of injected work and linear in r. 
The PDFs of T.Asm.T are plotted in figure la) for four 
values of t/tq. They are not Gaussian for small times 
T and extreme events have an exponential distribution. 
We now describe new results in this system. The PDF 
of the "trajectory-dependent" entropy As,- is plotted in 
figure lb) ; we have superposed to it the PDF of Asm,r at 
equilibrium (/ = A). These two PDFs are independent 
of the integration time. The two curves match perfectly 
within experimental errors. Therefore the "trajectory- 
dependent" entropy is equal in this case to the fluctu- 
ations of the entropy exchanged with the thermal bath 
at equilibrium. The average value of this "trajectory- 
dependent" entropy is zero within experimental errors ; so 
the total entropy production has the same average value 
than the entropy As,n_i-- The PDFs of the total entropy 
Astot.T/(Astot,T), computed by adding As,- to Asm,T, are 
plotted in figure Ic) for different values of t ; they are all 
Gaussian. 

In figure Id), we have plotted the symmetry functions 
of the dissipated heat (TAsm^-r) together with those of the 
total entropy. ^(Asin.r) is a non linear function of Asm^T-. 
The linearity is recovered for Asi„,r < (Asm.r)- The slope 
tends to 1 for large integration time. Entropy change in 
medium satisfies relation (1) [15]. On the contrary, the 
symmetry functions for the total entropy are linear with 
Astot,T for all integration times r and for all values of 
Astot,T : $(Astot,T) = E(T)Astot,T- The slope S(t) is 
equal to 1 for all integration times within experimental 
errors. Measurements can be done for other values of in- 
jected current and we find the same results. Thus total 
entropy satisfies relation (2). 
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AStot,r/<AStot,r> 



X^/<X^> 



Fig. 1: Resistance, a) PDFs of the normalized entropy variation in the system Asm,T/(Asm,T), with t/tq — 2.4 (o), t/tq = 4.8 
(D), t/tq = 14.5 (o) and t/tq — 29 (x). b) PDF of the variation of "trajectory-dependent" entropy Asj- for t/tq — 4.8. The 
distribution is independent on t/tq. Continuous line is experimental PDF of the entropy variation at equilibrium (Asm,T,cq at 
/ = A), c) PDFs of the total entropy production Astot,T/(Astot,T), with r/ro = 2.4 (o), r/ro = 4.8 (D), t/tq = 14.5 (o) 
and r/ro = 29 (x). d) Symmetry functions $ for Asin,r/(Asin,r) (small symbols in light colors) and Astot,T/(Astot,T) (large 
symbols in dark colors) for the same values of t/tq. 



This experimental result can be explained using a first 
order Langcvin equation and noting that fluctuations of 
the voltage 6V{t) = V{t) — {V{t)), when a current is ap- 
plied, are identical to those at equilibrium [15]. Thus 
the voltage V{t) has a Gaussian distribution with mean 
{V{t)) = R.I and variance {UbT/C), whereas its auto- 
correlation function is the same out of equilibrium and at 
equilibrium: 

{8V{t + T)8V{t)) = ^e}~^'^«\ (13) 

So we can compute the expression of the "trajectory- 
dependent" entropy from eq. (12) and we find: 



T.As^ 



\c5V{t 



r? 



\c5V{t)^ 



(14) 



Fluctuations of the voltage are identical to those at equi- 
librium, thus "trajectory-dependent" entropy is equal to 
the variation of internal energy divided by T at equilib- 
rium and to the opposite of the entropy variation in the 
system at equilibrium. Using eq. (7), (10) and (14), the 
expression of the total entropy is : 

rt+T 

T.Astot.r = / / V{t') - Ito {6V{t + r) - SV{t)) di' 

(15) 



We experimentally see that the PDF of Astot,r is Gaus- 
sian, so fully characterized by its mean value and its vari- 
ance. Its average value is linear in r ((Astot,r) = RPt/T) 
and equals the mean injected work divided by the tem- 
perature T. Its variance is computed using eq. (13) and 
we obtain cr^st^^ ^ = 2RPkBT/T . For a Gaussian distri- 
bution, the symmetry function of Astot.r is linear with 
Astot,T, that is $(Astot,T) = SAstot,T- The slope S is re- 
lated to the mean and the variance of the total entropy : 
S ~ 2(Astot,r)/CT^5 = i/kB- Experimentally, we have 
normalized the total entropy by ks , and the slope is equal 
to 1 for any r as shown in fig. Id). 



We now consider the second experimental system. It 
is a torsion pendulum in a viscous fluid which acts as a 
thermal bath at temperature T. The system is driven out 
of equilibrium by an external deterministic time depen- 
dent torque M. All the details of the experimental setup 
can be found in [3]. The torsional stiffness of the oscil- 
lator is C = 4.65 • 10~^ N.m.rad"^, its viscous damping 
V, its total moment of inertia /eff , its resonant frequency 
/o = luo/{2tt) = ^C///(27r) = 217 Hz and its relaxation 
time Tq = V /{2Ics) ~ 9.5 ms. The angular motion of the 
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oscillator obeys a second order Langevin equation : 



d^0 2 d0 



dt^ 



Tn dt 



M + ri 
C 



(16) 



where rj is the thermal noise, delta-correlated in time of 
variance 2kBTi>. The work injected into the system be- 
tween ti and ti + T is : 



/ti+T jg 

M{t') — {t')dt' . 



(17) 



The dissipated heat is computed according to eq. (3) 
where, in this case, the internal energy U{t) is : 



u{t) = ^ceitf + i/eff^(t)2 



(18) 



We investigate a periodic forcing : M{t) = A/q sm{u!iit) ( 
A/q = 0.78 pN.m and a)d/(27r) = 64 Hz). The integration 
time r is chosen to be a multiple of the period of the forcing 
: Tn = 2mr/ujd. The average responses of the system < 
d{t) > and < 9{t) > arc periodic function of the pulsation 
ujd and the system is in a steady state. Results for injected 
work and dissipated heat in this case arc reported in [3,17]. 
The "trajectory-dependent" entropy is not as simple as 
in the case of the resistance. The system has two inde- 
pendent degrees of freedom {9 and 9) and its expression is 



Asj 



-kfi In 



p{9{U + Tn),^).p{9{U + T„, (/?)) 
p{9{ti + r„), ip).p{9{U + T„, If) 



(19) 



The DFT (eq. (2)) is valid for each fixed starting phase 
If = tiUd [21]. For computing correctly the total entropy, 
we have to calculate the PDFs of the angular position and 
the angular velocity for each initial phase f. Then wc 
compute the "trajectory-dependent" entropy. As fluctua- 
tions of 9 and 9 are independent of f [3] . These distribu- 
tions correspond to the equilibrium fluctuations of 9 and 
9 around the mean trajectory defined by {9{t)) and {9{t)). 
As a consequence, we can average Asr„ over f which im- 
proves a lot the statistical accuracy. We stress that it is 
not equivalent to calculate first the PDFs over all values 
of 99 — which would correspond here to the convolution 
of the PDF of the fluctuations with the PDF of a peri- 
odic signal — and then compute the trajectory dependent 
entropy. 

In figure 2a), we recall the main results for the dissipated 
heat TAsin,r„- Its average value (T.Asi„,r„) is linear in t„ 
and equal to the injected work. The PDFs of T.Asni,T„ 
are not Gaussian and extreme events have an exponential 
distribution. Let us now describe new results in this sys- 
tem. The PDF of the "trajectory-dependent" entropy is 
plotted in fig. 2b); it is independent of n. We superpose to 
it the PDF of the variation of internal energy divided by T 
at equilibrium : the two curves match perfectly within ex- 
perimental errors, so the "trajectory-dependent" entropy 
can again be considered as the entropy exchanged with 



the thermostat if the system is at equilibrium. The aver- 
age value of Asr„ is zero, so the average value of the total 
entropy is equal to the average of injected power divided 
by T. In fig. 2c), we plot the PDFs of the normalized to- 
tal entropy for four typical values of integration time. We 
find that the PDFs arc Gaussian for any time. 

The symmetry functions of the dissipated heat 
$(Asni.r„) and the total entropy (f>(A.Stot.T„) are plotted 
in fig. 2d). For the dissipated heat, the symmetry function 
is a non linear function of ASm,T and we observe a linear 
behavior for Asm,T„ < (Asni,T„) with a slope that tends 
to 1 for large time. For the normalized total entropy, the 
symmetry functions are linear with Astot,T„ for all values 
of Astot.Tn and the slope is equal to 1 for all values of t„. 
Note that it is not exactly the case for the first values of 
r„ because these are the times over which the statistical 
errors are the largest and the error in the slope is large. 

In rcf. [3], we have already shown that, when a torque 
is applied, the fluctuations around {9{t)) have the same 
statistics and the same dynamics as fluctuations at equi- 
librium. Using the expression of the distribution of the 
angular position and the angular velocity, we can compute 
the "trajectory-dependent" entropy from eq. (19): 



T.Asr„ = -C {S9{U + T„)^ - 59{U 



^Ies[S9iU 



- 59{U) 



(20) 



where 59 and 59 are the fluctuations around the mean 
trajectory : 9{t) = {9{t))+59{t) and 9{t) = {9{t)) +59{t). 
The "trajectory-dependent" entropy is equivalent to the 
variation of internal energy for the system at equilibrium 
divided by the temperature of the bath. The total entropy 



T.Astot,r„ 



Wr-. 
1 



-C9{U){59{U 



59{U) 



Iofid{U)i59{U 



59{U)) 



(21) 



Experimentally, we observe that the PDF of the total en- 
tropy is Gaussian. We can calculate the mean value and 
the variance of the total entropy for any t„. We find that 
(T.Astot,r„) is equal to the injected work. Using the first 
law of thermodynamics and the equation of motion, we 
write the dissipated heat as the difference between the 
viscous dissipation and the work of the thermal noise : 



r.A.s 



ti+-r„ 



v9{t'Ydt' 



ti+T„ 



9{t')r^{t')dt' (22) 



This expression holds at equilibrium as well as out of equi- 
librium. The only difference is that when out of equilib- 
rium {9{t)) ^ and {9{t)) ^ 0. After some algebra the 
total entropy is : 



T.Ast. 



ot,rn 



t^+T^ 



{9{t')ydt' 
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Fig. 2: Torsion pendulum, a) PDFs of the normalized entropy variation Asm,T„/{Asm,T„) integrated over n periods of forcing, 
with n = 7 (o), n = 15 (D), n = 25 (o) and n = 50 (x). b) PDFs of Asr„, the distribution is independent of n and here n = 7. 
Continuous line is the theoretical prediction for equilibrium entropy exchanged with thermal bath Asm,T„,oq. c) PDFs of the 
normalized total entropy Astot,T„/{Astot,Tn), with n = 7 (o), n = 15 (D), n — 25 (o) and n = 50 (x). d) Symmetry functions 
for the normalized entropy variation in the system (small symbols in light colors) and for the normalized total entropy (large 
symbols in dark colors) for the same values of n. 



2iy 



ti+T„ 



ti 



{e{t'))S0{t')dt' 



(23) 



ti 



The average 



value of the 
and its variance is 



total entropy is 



(f^Ast„t.^„) 



2fcB(Astot,r„)+S/r2 

B = Aiy dudv{e{u)){9{v))i^{u,v){2A) 

^Piu,v) = iy{Se{u)S0{v)) - {5e{u)ri{v)) (25) 

The first term in the function ip is the autocorrelation 
function of the angular velocity. This function is sym- 
metric around u = v. The second term is the correlation 
function of the angular velocity with the noise. Due to the 
causality principle, this term vanishes if w < v. Changing 
variables to r = (u + v)/2 and s = u ~ v, cq. (24) can be 
rewritten : 



B 



t^+T„ 



dr {e{r + s/2)){e{r-s/2))tP{r,s) (26) 

Jo 



After some algebra wc can show that the correlation 
function {S9{s)ri{0)) is two times the autocorrelation 
function {66{s)S9{0)), therefore '0 = 0. Thus we ob- 
tain that the variance of the total entropy is equal to 
2fcB(Astot,r„}- The Fluctuation Relation for the total en- 
tropy is : $(Astot,n) = l/fcsAstot.n for all times t, for all 
values of Astot.n and for any kind of stationary forcing. 

For our two experimental systems, we have obtained 
that the "trajectory-dependent" entropy can be consid- 
ered as the entropy variation in the system in a time r 
that one would have if the system was at equilibrium. 
Therefore the total entropy is the additional entropy due 
to the presence of the external forcing : this is the part 
of entropy which is created due to the non-equilibrium 
stationary process. The derivation we gave for a second 
order Langevin equation can be extended to a first order 
Langevin equation : total entropy (or excess entropy) sat- 
isfies the Fluctuation Theorem for all times and for all kind 
of stationary intensity injected in the circuit or all kind of 
stationary external torque. The ratio between the average 
value of the total entropy at r = r^ (relaxation time) and 
the variance ct^ of fluctuations the entropy variation at 



'(/'(r, s) = 2iy{Sd{s)Sd{0)) — (66{s)ri{0)) (27) equilibrium characterizes the distance from equilibrium d 
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(Asto 



-'cq 



^rid ^As 



(28) 



"cq 



where Hd is the number of degrees of freedom. For the 
second equality, we use the Gaussianity of Astot,T, *•£• 
(Ta. = 2fcR(Astot t) and the variance of of the fluctu- 
ation of entropy variation at equihbrium in terms of ks, 
i.e. cr^ = 3/2ndkg. It turns out that this expression for 
d is the same that was defined in [3] with a completely 
different approach. Eq. (28) indicates that, when the sys- 
tem is driven far from equilibrium, cToq becomes negligible. 
As a consequence the fluctuations of the total entropy be- 
come equal to the fluctuations of the entropy variation in 
the system in a time r. In other words, the PDFs of the 
dissipated heat far from equilibrium are Gaussian. 

In conclusion, we have studied the total entropy when 
the system is driven in a non-equilibrium steady state. We 
have shown that the Fluctuation Theorem for the total 
entropy is valid not only in the limit of large times, as it 
is the case for injected work and dissipated heat, but also 
for all integration times and all fluctuation amplitudes. 
In the two examples we have discussed, the total entropy 
corresponds to the difference between the entropy change 
in medium out of equilibrium and at equilibrium. 

We thank U. Seifert and K. Gawedzki for useful discus- 
sions. This work has been partially supported by ANR- 
05-BLAN-0105-01. 
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